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ABSTRACT 


Rating is a process in which we relate observed perfor- 
mance to a designated concept of Standard. This process is 
usually carried out to determine the “standard time". Per- 
forming the job in the standard time is called "standard 
performance", 

There are two major methods of rating, 

(1) methods using a mathematical formula, 
(2) methods using judgement. 

The mathematical formula methods are not considered as 
being accurate and are not in general ute. Industry largely 
makes use of those methods involving judgement on the part 
of the rater. 

Time study engineers in industry today have been on the 
job various lengths of time; have received their time study 
education from various sources, and utilize different con- 
cepts of "standard performance". It is believed thet their 
accuracy in rating is affected by these and other factors 
such as area of employment, size of plant, as reflected in 
number of employees, and size of city ín which plant is lo- 
cated. The objective of this thesis was to determine if any 
or all of these factors affect the accuracy and consistency 
of the ratings made by a typicel group of time study engineers 
from the Mid-West region. This was accomplished by analyzing 
the ratings of job films in accordance with the following 


breakdowns: 
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. Entire group. 


Area. 


. Experience. 
Initial source of time study training. 
. Concept of “standard performance". 


. Size of plant. 


ο ο ^» Ga ὁ سر‎ 


. Size of city in which plant is located. 

"ith the engineers assembled in a room, films of an 
operator performing a synthetic task were projected. The 
job was a simple laboratory operation, representative of 
light factory work. The films were divided into 12 loops 
with tne operator working at a different pace in each loop. 
Loops were projected in a random order of pace. Engineers 
were instructed to rate by cycle and to employ any method 
of rating that they desired. Method of performing the job 
was stipulated to be correct. In order to place all ratings 
on a mutually comparable basis and to simplify the mathe- 
matical problem, Rating Conversion ¿cales were used by each 
man to convert his raw rating to that figure he would have 
assigned had he assumed 130 to be the maximum numerical valus 


he would expect of the typical operator in his plant. 


Conclusions. 
An ahelysis of the results of a group of typical time 


study engineers when rating job films leads to the following 


conclusions; 
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B. ize of city. Size of city in which the plant is 
located apparently has little or no bearing on the raters! 
accuracy. 

9. Consistency followed by the same direction as 
accuracy in all cases. It was, however, slightly higher. 
This was to be expected from the manner in which the data 
were handled. 

This analysis suggests that when rating a job film we 
can probably expect of tíme study engineers, in terms of tne 
percentage of personnel within limits indicated, the follow 
ing degrees of accuracy: 

45% level: more than one third---38%. 

£715 level: almost one half-------484. 

+10% level: almost two thirds-----62%. 


+20% level: the great aajority----86%. 
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AN EVALUATION OF TINE STUDY RATINGS OF A SYNTHFTIC TASK 
INTRODUCTION 


“Motion and time study refers to the analysis cf the 
work ond time necessary to do a certain job"., To find the 
time necessary we usually resort to a stop watch time study. 
A stop watch time study is accomplished by observing an 
operator performing the task and recording the time obtained. 
However, we note that if we should time another operator per- 
forming identically the same job, in the some manner, we very 
probably would obtain a different time of accomplishment. 
And is we studied a third operator we might get a third 
value of time. The question now arises, "which one of these 
workers is performing the task in the correct amount of time"? 
The answer to this question is required to establish a 
“standard time" for the job in questicn. Performing the 


job in the standard time is called "standard performance". 


One definition of standard time given by Munde1? is, 
"the time necessary to do a certain job, defined as to 
method and conditions Surrounding the work, by a operator 
physically fit for the job ans the typical operator who could 


be expected on the job, possessing sufficient skill to do 





1 4. E, Mundel, Systematic Motion end Time Study, p. 4, 
Prentice-Hall, Inc., New York, 1947. 


2 Ibid., p. 147. 
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tne job properly, adapted to the job, and working at a pace 
100/130 of the maximum he could maintain for the working day 
without harmful physical effects". But with all of these 
conditions unaderstoc’ and defined, it is still necessary to 
determine what relstionsnip the performance of the operator 
observed bears to the pace defined as standard. The vrocess 
of relating observed performance to a designated standard is 
called "rating", and further discussion will be confined to 
this subject. 

There are two major methods of rating, 

(1) methods using a mathematical formula, 
(3) methods using judgement. 

(a) Multiple factor systems, 

(Ὁ) single factor systems. 

Because of the great number of variables affecting the 
operators time the mathematical formula methods are not con- 
sidered as being accurate, are not in general use, and will 
not be considered here. 

An example of the judgement method is the "effort" 
rating plan. This plan involves two steps, 

(1) judge the difficulty of the job and imagine a 
concept of reasonable verformance, 

(3) compares what he sees to this concept. 
To carry out this method the time study man should be fami- 
liar with the visible appearance of the steps in the range 


of effort, as reflected in pace, on each type of job he ob- 
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serves.” In a plant with a variety of jobs this is not always 
feasible. 

Now judgement must involve the determination of the effect 
of the operator's skill, aptitude, and effort on his perform- 
ance. The system advanced by Munde1* accomplishes the above 
and entails the following steps on the part of the rater, 

(1) compares the workers pace to a fixed concept of 
speed, 

(2) adjusts the observed value for difficulty of the job. 

It becomes obvious that a standard pace must be defined. 
The standard pace may be a man walking on a level at 5 miles 
per hour. Also it could be a person dealing a deck of carde 
into 4 equal stacks in one half of a minute.” It is evident 
some value or representation of pace must be made in order 
that judgement of pace be possible and effective. A physical 
embodiment of this designated pace could be a film cf an 
operator walking or dealing cards at the respective rates 
indicated above. Some time study men have their own concept 
of standard performance and some utilize a film as previously 
mentioned. "hen using the Presrrave " system a different con- 


cept of the standard pace for each job is required. 


ὁ Ibid., p. 157. 
4 Mundel, op. cit., p. 157. 


o Ralph Presgrave, Dynamics of Time Study, 2nd ed., 
p. 154, MoGraw Hill Book Co., Inc., Mew York, 1945. 
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hating mey be expressed as points per hour? Or 58 e 


percentage figure. Percentage numbers are more widely used 
and will be employed in this thesis. There are various 
percentage systems in use but the following wili be employed 
here; the maximum performance that could be expected of the 
typical worker, for the entire working day, without harmful 
physical effects wiil be 130 and standard performance will 
be 100/130 of this value. 

To adjust for difílculty of performance on difierent 
jobs, tables are prepared with certain allowances for adjus- 
tment purposes, 

Time study engineers in industry today have been on the 
job various lengths of time; have received their time study 
education from various sources, and utilize different con- 
cepts of “standard performance". It is believed that their 
accuracy in rating is affected by these and other factors 
such as area of employment, size of plant, size of city in 


which the plant is located. 





6 Ralph X. Barnes, Motion and Time Study, Srd ed., 
p. 355, John Wiley & Sons, Inc., New York, 1949. 
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OBJECT 


The object of this thesis is to determine if any or all 
of these aforementioned factors affect the accuracy end con- 
sistency of ratings made by typical group of time study 
engineers from the Mid-West region. This object will be 
investigated by analyzing the ratings of job films in 
accordance with the following breakdowne;: 

1. Entire group. 

2. Area. 

a. Northern Mid-West, less Wichigen. 
b. Central Yid-West. 
c. Southern Mid-West. 
d. Yichigan. 
û. Experience. 
a. 0-6 months. 
b. 6 months - 3 years, 
ο. 2-4 yenra. 
d. Over 4 years. 
4. Initial source of time study training. 
2. College. 
b. Company. 
5. Concept of "standard performance". 
4. Rater uses own concept. 
b. Rater uses a film or some other embodiment. 
6. Size of plant, (number of employees). 
a. 0-101 men. 
b. 101-1000 men. 
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c. Over 1000 men. 

Size of city in which plant is located. 
a. Under 5000. 

b. 5000-10000. 

c. 10000-235000. 

d. 25000-50000. 

e. 50000-100000. 

f. Over 100000. 
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"ROCEDURE-PART A 


In order to carry out the objectives of thir thesis it 
Was necessary to have a typical group of time study engineers 
Tate a task or a number of tasks. To obtain this data In- 
dustrial Engineers from various firms located in Indiana, 
Illinois, Michigan, Ohio, and Wisconsin were invited to attend 
a "work session" at Purdue University on the 15th of varch, 
1950. | 

Data could have been obtained by having the raters view 
either a film of an operator performing a tesk or vier an 
actual operator. For various reasons a film was chosen rather 
than en operator. Bome of these reasons are: 

1. A film was already available thus obviating the 
necessity of training an operator. 

2. A film is more convenient as it can be viewed by a 
much larger group than could an operator working at a task. 

3. Metiod and skill can be maintained more consistently 
and accurately by means of a film since many operators are 
distracted shen performing in the presence of an audience. 

4. It wes shown by Margolin’ thet time study engineers 
Yate more accurately and consistently from a job film than 
from an operator. 

The film selected consisted of sn operator performing a 


simple task, a job description of which is appended. The 





7 Louis Margolin, “A Comparison of Two Methods of Pre- 
sentation For Time Study Ratings", Unpubliened Masters Thesis, 
Purdue University, 1948. 
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film sas prepared in 1949 under the supervision of Lebrer.* 


It was divided into 36 parts in which the operator performed 
at a different pace in each pert. The film had been carefully 
edited to eliminate any fumbles, false movements or eny other 
irrsrsularities. Consideratiorns involved in the selection of 
this film were: 

1. It involves sharp clear motions and elements. 

2. Includes motions cf the hands and arms that are 
typical of light factory work. 

Twelve loops were prepared from the film. They were 
carefully checked to insure that the ratio between the elem- 
ents of a given loop in each cycle were the Same. Loops were 
arranged in a random order of pace for projection purposes. 

It being realized that different time stucy men utilize 
difierent numerical maximum percentage values as expectable 
of the typical worker, rating conversion scales were prepared 
for their use. In this manner they could convert their raw 
rating to the one in which 130 represents the typical maximum. 

Two IBM mark sensing cards were prepared for issuance 
to each man. These cards were punched with identifying data 
for each men. It was arranged that each man would then enter 


his "converted rating" directly on the IBM cards. 





8 R. K. Lehrer, “Development and Evaluation of a Pace 
Scale for Time Study Rating", Unpublished Doctors Thesis, 
Purdue University, 1949. 
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PROCEDURE-PART B 


The engineers assembled in the lecture room of the 
Electrical Engineering building and after a greeting by Dr. 
M. E. Mundel, Professor of Industrial Engincering, General 
Engineering Department, Purdue University, a questionnaire 
was Landed out to each mam. This questionnaire was for the 
purpose of collecting information for the thesis of Borrus.* 
It further served the purpose of procuring the necessary 
information such as area, experience, etc., of each man for 
this thesis. 

On completion of the questionnaire the IBM mark sensing 
cards, special pencils, rating conversion Scales, were issued 
to each man. Instructions for their use was given. 

Engineers were requested to rate by cycle, using their 
own system of rating. Method of the job was stipulated to be 
correct. They were further reminded to use the rating con- 
version scales in order that all Tatings would be on a 
mutually comparable basis. 

A loop was projected for a short time to familiarize 
each man with the method of the job. On completion of this 
showing the session began. Loops were projected at the Same 
speed at which they were made. About 3 minutes were allowed 
for projection and about 1 minute for recording of ratinge. 


This procedure was continued until all 132 paces were shorn. 


2 Bernard S. Borrus, "The Present State of Time Study", 
Unpublished Masters thesis, Purdue University, 1950. 
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PROCEDURE-PART 0 


After all 12 paces had been rated the IBM cards were 
delivered to tha 13% Computing Laboratory where all necessary 
data were punched on the cards. The iBM Laboratory supplied 
tne following information for each pace and for each categ- 
ory of breakdown: 


1. Number of raters. 


do 


Totais of their scores. 


(1 


. All ratings made. 


US 


. Humber of raters with a specific score. 

With this information, corrected values for each pace was 
determined. Mathematical procedure for determining this is con- 
tained in Appendix B. With the corrected value of each pace 
obtained, and the information from IBM, analyzation for 
accuracy was made by noting the number and percentage of 
raters within +5%, 474%, +10%, 420% of the corrected values 
for each pace and for each category of breakdown. 

To analyze for consistency, the same procedure ras employ- 
ed except the average of the raters' values was used as the 
measure about which the variation was appraised. 

To arrive at conclusions the data were investigated by 
inspection and by the *analysis-of-variance” technigue. The 
analysis-of-variance technique was employed at the +5%£ and 
410% level of accuracy in all cases and at the +20% in a fer. 
Appendix B has a short discussion on the analysis-of-variance 


technicue, 
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Raters' averages were plotted against the corrected 
values for each category of breakdown. A line, determined 
by the method of “least squares", was drawn through these 
points. This line indicated the points at which raters 
tended to depart from the +5% and +10% levels cf eccuracy. 
Appendix B contains a short discussion on the “least ۲۷ 


method of fitting a curve through a set of points. 
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CONCLUS IONS 


hn analysis of the results of a group of typical time 
study engineers, when rating job films of various paces, 
leads to the following conclusions; 

i. For all categories, a plot of the average of the 
ratings agsinst the corrected ratings indicetes a trend of 
tae time study engineers to rate too low at the higher values 
and too high at the lower values. 

3. The line best fitted, by mathematical means, to all 
points for the entire group, suggest the trerd of this group, 
on the average, to be outside the +5 level at values below 
about 93; the 410$ level at values below abcut 75; the -57 
level at values greater than 165; the -10% level at values 
in excess of 220, 

¿. Area. The Michigan area had a comparatively low 
degree of accuracy, the snalysis-of-variance test showed it 
to be significant, but since their amount of experience «nd 
familiarity with the method of rating a job film was not 
determined, and the sample was very Small, their score is 
disregarded. Discounting the Michigan category, raters froma 
Various eres’ rated essentially the same. Therefore, the 
area in which the plant is located appears to have little 
or no relationship to accuracy. 


4. Experience. Groups with 6 months or were experience 





rated about the same but with greater accuracy than those 


with less experience. Those in the 2-4 years category wera 
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slightly higher than the rest. The analysis-of-variance test 
failed to indicate that the low score of the 0-5 months group 
wee significant, but in view of the irregularity cf their 
accuracy, as indicated by inspection of Table 7a, it is 
suerested that ín general at least 6 monthe experience is 
recuired to make the cualified time study engineer but that 
accuracy tnen remains agbout the same with increased experience. 

5. Education. The accuracy of the raters at the 45% 
level is practically equal. The 1% difference ir their 
accuracy is not significant. However, at the £10$ level 
those raters receiving their initial time Study training 
from a company show a significantly, by enalysis-of-variance 
test, greater accuracy. This suggests, at least for this 
group, at the higher level of accuracy, initial source of 
time study training does not affect accuracy. At a less 
rigid degree of accuracy, time study men receiving iritial 
time study training from the company are more accurate than 
those receiving it from a school. This may not be true of 
those receiving modern training from either echool or 
company. 

6. Qoncent cf Standard Performance. Raters using = film 
or some other embodiment of standard performance as common 
practice were superior to those using their own concept 
despite tne fact that no film aid was used in this phase. The 
difference in accuracy was not significant at the +5% level 


of accuracy but was definitely significant at the +10% level. 
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It is therefore suggested that raters should use a film or 
some other embodiment of "standard performance". and this 
reinforces the last statement of conclusion 5. 

7. Number of Employees. By inspection the raters in 
plants emoloying less than 101 men rated a little lower than 
tnose in larger plents. However, this difference is not 
significant. Therefore the size of plant at reflected in 
number of plant employees apparently has no effect on raters 
accuracy. 

8. Size of city in whioh plant is located. Inspection 
reveals a wide difference in accuracy between a city of less 
than 5,000 people and a city of 5,000-10,000 people; the 
analysis-of-variance tests reveals this difference to be in- 
significant at the +5% level of accuracy and barely significant 
at the #10% level. It is therefore suggested that size of city, 
in which the Plant is located, does not afiect raters accuracy 
significantly. 

9. Consistency followed by the same direction as accuracy 
in all cases. It was, however, slightly higher. This was to 
be expected from the method in which tne data were handled. 

10. This analysis suggests that when rating e job film 
we car probably expect time study engineers in terms of the 
percentage of personnel within limits indicated, to perform 
with the following degrees of accuracy: 

+5% level: more than one third----38%. 


473% level: almost one half-------- 484. 
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Table la 


Breakdown: Tabulation of Numerical Results of all Categories. 
Computed for Accuracy 


454 +73% +10% +20% 
vo. % πο. % Wo. % πο. 4 
Overall. 27 38 35 48 45 62 82 86 


Northern ۷610-۷68۷ , 
Less Michigan. 7 37 11 53 12 681 17 85 


Central Mid-West. 12 38 17 95 20 65 7 89 





Southern Mid-West. 5 42 7 59 9 72 14 88 

Michigan. 2 31 ὦ 36 4 45 7 77 

Experience, 

0-6 mos. 2 33 3 47 4 58 5 78 

6 mot.-2 yrs. 7 42 9 53 10 64 14 86 
2-4 yrs. 7 3 10 54 13 66 18 93 
Over 4 yrs. 11 39 16 53 18 63 26 89 

Education. 

Coliege. 8 36 11 49 13 59 18 81 

Company 16 38 24 56 38 66 39 87 


Use own Concept of 20 37 38 51 34 62 49 87 
Standard Performance 


Uses film or other 7 44 9 61 11 75 15 98 
embodiment of 
Standard Performance 
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Table 1b 


Breakdown:  Tabulation of Humericsl Kesults of all Categories. 


Computed for Consistency 


45% +714 +10% 420% 
Ko. % No. 4% No. % No. % 
Overall. 29 40 £41 57 50 6 68 86 
Northern Mid-West, 
Less Michigan. 8 39 11 3S3 18 66 1" 86 


Central Mid-fest. 13 42 18 58 28 73 27 88 


Southern Mid-West. 6 51 8 63 9 74 11 88 
Michigan. ὁ $2 9 37 4 48 6 71 
Experience, 

0-6 mos. 2 35 3 $1 4 65 5 82 
6 mos.-2 yrs. 6 40 9 57 11 66 14 87 
2-4 yrs. 8 39 12 61 13 70 17 91 
Over 4 yrs. 13 44 17 58 20 67 26 90 
Education. 

College. 8 38 13 54 14 64 18 82 
Company. 19 43 37 60 32 71 40 88 


Use own Concept of 20 38 29 53 37 68 47 87 
Standard Performance 


Uses film or other 8 56 11 72 13 64 15 98 
embodiment of 
Standard Performance. 
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Table 2a 


Breakdown: Entire Group. 
Number of Katers: 72 


Evaluation for accuracy. 


Corrected Sequence +5% +74% +10% +20% 
Ratings. Shown 
Ho. $ No. % No. % No. € 


155 12 29 47 46 64 48 67 66 2 
143 4 23 32 32 44 47 65 67 93 
137 11 38 55 46 64 57 79 6ο 2 
132 8 34 47 44 61 50 69 63 87 
122 1 $1 Ὁ 45 ο 66 ΒΕ ο ο 
118 5 S0 42 45 G5 53 72 65 0 
105 10 35 34 53 44 42 58 63 97 
98 2 31 43 40 55 49 66 BA 89 
95 6 26 36 B 44 4} 58 57 9 
92 3 24 33 28 3 35 49 60 83 
81 9 17 34 31 29 28 386 53 4 
79 7 18 25 26 36 38 44 54 75 
Average: 


37 38% 35 48% 45 62% 62 86% 
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Breakdown: 


Number of Raters; 


Entire Group 
72 


Table 2b 


Evaluation for consistency. 


Average 
Ratings 
149 
135 
135 
130 
121 
115 
110 
103 
101 
98 
86 
84 


Average; 


Sequence 
Shown 


13 
A 
11 


ΟἹ 


10 


2 wd ο οι δ 


49 
50 
«2 
46 
46 
36 
37 
og 
31 
26 
28 


40% 


174% 
No. % 
44 61 
49 68 
48 67 
45 63 
48 67 
43 60 
43 58 
43 60 
37 51 
41 57 
22 31 
28 39 
41 57% 


£10% 
No. 4 
53 72 
62 86 
59 82 
48 67 
58 81 
54 75 
51 71 
48 67 
44 61 
49 68 
$1 50 
34 47 
50 69% 


420% 
Κο, $ 
64 89 
68 95 
66 92 
63 Ε8 
67 93 
66 93 
61 85 
64 B9 
58 81 
61 85 
54 75 
50 79 
62 86% 
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Table 3a 


Breakdown: Area-Northern Mid-West, less Michigan. 
Number of Haters: 20 
Evaluation for accuracy. 


Corrected Sequence +4 +34 +10% +20% 
Ratings shonn 


152 12 5 W 13 6 1» 66 19 5 
140 4 8 40 12 60 13 65 18 90 
134 11 9 45 313 60 17 85 18 90 
129 8 9 46 128 O 14 70 31?" 85 
119 1 186 80 17 8 18 90 20 100 
115 5 10 50 14 m 15 75 16 90 
1023 10 4 0 o 5 7 95 17 5 
96 2 T 355 ο» © B 56 ο ο 
93 6 8 40 g 45 9 45 16 80 
90 2 6 30 ιο BO 11 δ IF 88 
79 9 4 20 6 30 9 45 13 65 
77 7 ὦ 15 6 36 10 50 14 70 


Averaze: 7 37% 11 53% 12 61% 17 85 
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Breakdown: 


Humber of 


Area-Horihern Mid-West, iess Michigen. 


Raterg: 20 


Evaluation for consistency. 


Average 
Ratings. 
147 
132 
154 
127 
120 
113 
106 
101 
100 
24 
80 
79 


Average: 


Sequence 4+5% 
ohown 


No. % 
12 6 30 
4 14 70 
11 8 40 
8 8 ἄν; 
1 15 75 


σι 
لسم‎ 
سم‎ 
(7 
ο 


10 4 20 
8 7 5 
3 5 25 
3 9 45 
9 4 20 
7 4 20 

g 39% 


Table 3b 


£4. 
No. % 

8 40 
16 80 
11 55 
13 60 
16 80 
13 65 

8 40 
11 55 

7 35 
10 50 

7 55 

7 35 
11 52% 


110% 
Bo. % 
11 SE 
18 90 
13 85 
14 70 
18 90 
15 75 
10 50 
16 80 
14 70 
13 65 

9 45 

9 45 
13 66% 


430% 
No. € 
18 95 
19 95 
18 90 
17 65 
20 100 
18 90 
17 85 
19 95 
15 75 
18 90 
14 70 
14 70 
17 86% 


22 
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Table 4a 


Breskdown:  Area-Oentral Mid-Test. 

Number of Raters: 31 

Evaluation for accuracy. 

Gorrected Jequence 454 £714 {109 +20% 


Ratings Shown 
No. % No. % No. % Ho. % 





150 13 19 1 20 65 Z 74 SS 97 
4 13 39 17 ο st η x ο 

155 11 17 > 3 3" 335 θὲ ۵ 9 
138 8 15 4 18 58 27 8" 393 94 
118 1 13 43 23 74 οὗ 07 29 94 
114 5 15 48 30 05 23 8 ¿1 100 
102 10 8 25 15 48 16 58 5 δι 
35 2 18 48 19 61 2 ου 335 ο 

93 6 9 29 13 43 14 45 26 4 

90 ὦ 8 38 14 45 15 48 26 284 

79 9 5 16 9 2 Mu 36 395 74 

76 7 6 19 9 29 14 45 26 61 


Average: i2 38$ 17 55% 20 65% 27 29% 
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Table 4b 


Breakdown; Areu-Central Mid-West. 
Number of Raters: 31 
Evaluation for consistency. 


Average Sequence 45% 4735 
Ratings Shown 
No. % No. % 
143 12 13 42 18 58 
131 4 14 45 22 71 
129 11 18 56 24 8 
136 8 13 39 20 65 
119 1 13 42 22 71 
111 5 13 42 90 65 
107 ‚10 12 39 17 95 
101 2 13 43 15 48 
100 6 16 52 18 58 
95 3 lg 42 14 45 
84 9 10 32 14 45 
82 7 11 35 13 39 
Average: 13 42% 18 58% 


410% 
No. % 
27 87 
a9 94 
27 87 
26 84 
37 87 
25 74 
24 78 
a2 71 
19 2 
19 81 
14 45 
13 42 
22 73% 


420% 
Ho. & 
29 34 
31 100 
31 100 
au 94 
29 94 
30 97? 
28 οι 
34 78 
27 87 
26 64 
22 ri 
21 68 


88% 
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Table 5b 


Area---Southern Hid-Yest. 


Number of Raters; ۰ 
?valuation for consistency. 





Average 
Ratings 


18€ 
144 
145 
141 
135 
125 
117 
106 
102 
106 

96 

92 


Average: 


"enuence ۰ 56 
Own 

No. % 
12 10 83 
4 6 50 
11 10 83 
8 8 67 
1 6 50 
5 6 50 
20 3 43 
2 8 ιν 
6 5 42 
3 6 50 
9 5 42 
7 4 3 

6 514 


174 
No. % 
10 83 

B 67 
10 83 

ο 75 

6 50 

6 50 

" 56 

6 50 

è ®t 

9 75 

6 50 

5 42 


3104 
No. A 
11 92 
11 92 
11 932 
10 εὖ 

7 56 

9 75 

8 6? 

τ δὲ 

8 67 

9 75 

8 67 

7 58 

9 74% 


+20% 
Ko. % 
11 93 
112 9 
1} 92 
11 93 
1۸ © 
10 eS 
11 92 
10 83 
10 BS 
11 52 
9 75 
10 82 
11 eef 
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Breakdown: 


Number of 


Table 6b 


Area---kicnigsn. 


Raters: 


Evaluation for consistency. 


Average 

Ratings 
| 158 

145 

144 

134 

133 

123 

116 

107 

107 

111 

98 

92 


Average; 


Sequence 
Shown 
12 
4 
11 


a 


10 


3 0 UU © UD 


45% + 


= 
O 


N O  ὁωυ ο ὃν ο 4 ۵ A 


ΤῊ 
=) 


م 


44 
33 
33 
oo 
33 
de de 


o 


33 
11 
33 
33 
33 
55 


Ὁ ο U UNUN له له‎ 0 $ ^» a ο 


31% 3 


a 
a 


55 
55 
£6 
44 
22 
44 


22 
33 
55 
585 
55 


37% 


410% 


= 
ο 


a ο ο b ο A FP o^ » οι σι Οἳ 


66 
65 
55 
44 
a 
44 
55 
356 
AG 
55 
55 
33 


48% 


N 0 ο DD 3ο Oo q 2 -3 nr ۵ 


88 
77 
77 
77 


66 
66 
77 
66 
66 
66 
55 








Breakdown; 
Number of Raters; 
Evaluation for accuracy. 


Corrected Sequence 
Shown 


Ratings 


152 
140 
134 
199 
190 
116 
103 
96 
93 
91 
80 
77 


Average: 


13 
4. 


11 


ο 


10 


CO mM δῦ‏ © له 


Table 7a 


Experience---0-6 Months. 
6 


+5% +73% 
No. % No. % 
+ 67 4 67 
3 50 4 67 
3 50 4 67 
3 55 3 50 
c 67 4 67 
3 50 4 67 
1 17 2 33 
3 50 3 50 
0 1 17 
Q 3 33 
1۰ ۳ 4 e 
0 ο 2 33 
2 334 3 47% 


+10% 1204 
No. % No. 9 
4 67 6 100 
4 67 6 100 
5 8 6 100 
5 88 5 83 
5 83 6 100 
4 67 5 83 
8 950 δ 83 
4 67 5 83 
8 om 4 67 
8 50 3 50 
1۵ 1 8 50 
8 33 5 33 
4 58% 5 78% 


Gê 
τὰ 
δὲ 
τ 
02 


2 
E 
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va 
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Qa 
5 
v8 
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Table 7b 


Breakdown;  Experience---0-6 Konthe. 
Number of Raters; 6. 


Evaluation for consistency. 


Average Sequence +5% £714 
Ratings Shown 
No. No. % 
145 12 2 33 * 67 
133 é 2 33 4 67 
131 11 1 17 5 67 
129 8 & 33 3 50 
122 1 $ 50 4 67 
110 5 2 33 2 $93 
108 10 3 50 3 50 
103 3 4 67 4 67 
96 6 1 17 2 33 
95 3 3 50 ὦ 50 
84 9 0 0 2 33 
83 7 2 33 3 33 


Average: 2 35$ 3 51% 
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σι 


100, 
83 
100 
67 
83 


67 
67 
67 
67 


82% 


30 
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Table Ba 


Breakdown:  Experience---6 Months to 3 Years. 
Number of Raters: 16 


Evaluation for accuracy. 


Corrected Seyuence 456 474% +10% 420% 
Ratings Shown 
Νο. % No. % No. % No. % 


156 12 8 50 "Ὁ 36 6 ۲ 18 150 
144 e 6 37 9 ¥ 11 66 4 28 
138 11 5 31 9 56 ili 6y 14 88 
155 8 8 50 10 63 11 66 14 ۵ 8 
125 4 8 50 9 56 10 65 15 ο 
119 5 8 50 9 56 132 75 15 94 
106 10 8 5ο 10 63 13 75 14 88 
99 2 9 56 11 68 13 81 14 88 
95 6 6 37 7 44 9 86 ig 75 
93 3 7 44 9 56 9 56 315 64 
83 9 5 ol 6 y 6 37" ik ο 
80 7 3 13 4 25 7 44 11 9 


Average: 7 43% 9 53% 10 64% 14 86% 








bs Bee or bee 
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Table 8b 


Breakdown;  Experience---6 Months to 2 Years. 
Nuuber of Raters: 16 
Evaluation for consistency. 


Average Sequence 45% 471% 410% 420% 
| Ratings Shown, 


Μο. % No. 5% No. % No. ۶ 
153 12 5 38 11 69 12 75 15 94 
136 i 9 56 11 69 14 88 15 84 
136 li 5 31 8 50 19 75 lé 68 
130 8 6 38 10 63 10 65 14 68 
122 1 8 50 9 56 12 75 15 24 
110 5 7 E 11 69 12 75 15 94 
107 10 8 50 11 69 12 75 14 36 
105 2 9 56 10 63 12 75 15 94 
105 6 5 ol 7 44 8 50 13 ei 
103 à 8 50 11 69 11 69 15 94 
84 9 + 39 6 38 6 38 11 69 
83 7 3 13 5 öl 6 38 11 69 


Average: 6 40% 9 57% 11 66% 14 87% 
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eee keeles 
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Table Ya 
Breakdown:  Experienoe---3 To 4 Years. 
Number of Raters: 19. 


Evaiuation for accuracy. 


Corrected Sequence +5% 4714 +10% +20% 
Ratings Shown 
πο. % No. % No. 4 No. ὅ 
1556 13 9 47 14 74 14 74 19 100 
143 4 5 26 11 58 16 84 19 100 
137 11 10 55 11 58 17 90 19 100 
132 & 12 63 15 79 15 79 19 100 
122 1 9 47 14 74 16 84 19 100 
118 5 9 47 13 69 14 74 19 100 
105 10 6 32 8 42 12 63 18 95 
98 2 8 42 10 53 12 6 18 Ø 
95 6 6 32 9 47 11 58 16 84 
92 3 ۲ δν 8 «4 10 53 17 90 
81 ə 4 21 6 32 8 42 13 69 
79 7 3 16 4 21 6 32 15 9 


Average: 7 89$ 10 54% 13 66% 18 93% 








: | — A A "o Minn “a Fo" 


5 M. uu dT. t, t,» S, AV S Ls 
η T 
RT a Fa 778 ee Ot 
A ۷9۵ e زو با وا وا‎ 
Pr les . ^ 27 
TC O e a e y e P 
— — a 
μας 

















Breakdowns 


Wunber of 


Table 9b 


Sxperience---3 To 4 ۰ 


Raters: 19. 


Yvaluation for consistency. 


۸7 
Ratings 


147 
135 


Average: 


Sequence 45% 
Shown 
No. % 
12 7 a? 
4 10 ο 
11 9 47 
8 13 65 
1 9 47 
5 11 58 
10 9 47 
a ὦ 16 
6 7 37 
3 1 21 
9 5 26 
7 6 al 


8 394 


Ho. 


12 


% 

68 
79 
53 
79 
79 
68 
68 
42 
47 
63 
«3 
33 


61% 


410% 
Ho. % 
16 84 
18 95 
16 84 
15 νο 
16 84 
15 79 
15 79 
10 53 
9 47 
13 08 
e &2 
9 47 
15 70% 


4204. 


No. 
19 
19 


19 
19 
18 
18 
18 
15 
18 
13 
13 


% 
100 


100 


100 
100 


o (D 
ο 00 


64 





m 
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μα 
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Ereakdown: 


Number of Haters: 


Evaluation for accuracy. 


Corrected Sequence 
Shown 


Ratings 


151 
140 
133 
138 
119 
115 
102 
96 
92 
90 
79 
77 


Averace: 


12 
4 
11 


a 


10 


- qd ο ο δῦ 


Table 10a 


45% 
No. % 
14 

e öl 
20 69 
10 35 
14 48 
13 45 

8 38 
13 45 
11 37 

3 28 

5 17 

9 òl 
11 39% 


Experience---Over 4 Years. 


29. 


474% 


Ho. 
18 
16 
25 


16 


f 

62 
55 
86 
42 
69 
59 
4l 
55 
45 
4] 


410% 
No. % 
21 73 
19 66 
25 86 
32 6 
25 86 
23 5 
13 45 
19 66 
14 48 
14 48 

8 28 
17 59 
18 63% 


+20% 
Νο. $ 
BY 9 
27 es 
27 8 
26 960 
26 90 
27 9 
26 90 
27 93 
27 93 
25 86 
21 78 
25 79 
26 894 


35 
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ds Tos هب‎ 8 ω و‎ 








5 ٩ 8 38 αὶ ἃ α 3 ἢ 
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۵۵ج‎ ۵ 
538 8 5 8 38 
63341683337 
"883553232223 
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"2222522232755 
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Tabie 10b 


Breakdown; Experience---Over 4 Years. 
Nunber of Raters: 9 


Evaluation for consistency. 


Average Sequence +5% 4714 +10% 420% 
Ratings Shown 
No. % No. % No. % No. % 
1-5 19 13 45 20 69 33 79 27 93 
153 > 16 59 23 76 24 83 28 97 
155 il 20 69 25 86 25 86 27 98 
1238 8 13 45 18 623 19 66 26 90 
117 1 16 55 22 76 22 76 28 97 
113 5 11 38 18 62 21 75 27 ος 
108 10 9 ól 13 45 19 66 35 86 
99 2 11 38 13 45 19 66 37 93 
97 6 11 48 17 59 19 66 27 93 
95 à 10 35 13 45 18 62 36 90 
87 9 10 35 11 $8 14 48 23 79 
82 7 14 48 14 48 14 48 22 76 





Average: 13 44% 17 59% 20 674 36 90% 
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Table lla 
Breaxdowm: Education---Initial Time Study Training Received 
In College. 
Number of Raters; 33. 


Evaluation for accuracy. 


Corrected Sequence +5% 47414 +10% +20% 
Ratings Shown 
Xo. € No. % No. 4 Νο. 9 
156 13 13 59 15 ۵ 17 77 19 εν 
144 - 8 36 15 59 16 73 30 91 
15€ 11 9 41 12 55 15 68 18 82 
133 8 9 41 13 55 1% 64 17 77 
122 1 10 46 15 68 15 68 20 Q1 
119 5 11 50 13 59 14 64 19 87 
10€ 10 9 4] 11 50 13 59 18 82 
99 2 8 36 11 50 14 64-20 91 
96 6 7 33 7 52 11 50 16 73 
93 à 6 37 7 38 7 32 18 82 
82 9 9 9 5 23 o 5 15 68 
80 7 5 33 8 56 9 41 14 64 


Average: 8 37% 11 49% 13 58% 18 81% 
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Table 11b 
Breakdomm:  Vducation---Initisl Time Study Training Received 
In Coilege. 
Number of Raters: 33 


Evaluation for consistency. 


Average Sequence +5% 474% 410% +20% 
Ratinge Shown 
No. 9 No. % Xo. % Ko. % 
159 13 ii 50 16 73 17 77 19 RG 
138 4 | 13 55 15 68 15 68 19 86 
138 11 9 4i 13 55 15 68 19 89 
131 8 5 25 11 50 13 59 17 77 
191 1 10 45 15 68 17 77 20 91 
112 5 7 32 13 59 13 58 20 el 
110 10 12 55 15 59 16 78 18 eg 
102 2 5 23 12 55 15 58 20 91 
101 6 7 33 10 46 12 EE 15 73 
99 3 10 46 11 50 15 68 17 77 
87 9 4 18 6 27 11 50 16 73 
83 7 7 33 8 36 11 o0 16 76 


Average: 8 38% 12 54$ 14 64% 18 83% 
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Table 12a 
Breakdown; Education---Initial Time Study Training Received 
With the Company. 
Number of Raters: 45. 


Evaluation for accuracy. 


Corrected Sequence +54 473% +10% 420% 
Ratings Shown 
No. % No. % No. % πο. % 
153 13 22 49 30 67 32 71 43 95 
141 $ 17 38 29 64 31 69 42 93 
135 11 25 55 35 78 41 91 42 93 
130 8 25 56 33 71 39 87 42 93 
191 1 20 44 31 69 37 82 43 95 
117 5 18 40 30 67 31 69 42 93 
104 10 12 27 20 E 96 58 40 69 
97 3 19 42 24 53 öl 69 40 89 
94 6 14 31 19 43 21 47 36 80 
gi ὦ 14 31 22 49 35 55 $6 80 
80 9 13 27 14 31 19 42 30 67 
7€ 7 7 16 17 38 21 47 ó4 75 


Average: 16 38% 24 56% 38 66% 39 87% 
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Table 13b 


Breakdown;  Education---Initial Time Study Training Received 
With the Company. 
Number of Ratere: 45 


Evaluation for consistency. 


Average Sequence 156 +744 4104 4204. 
Ratings Shown 

πο. % No. $% No. % No. % 
147 13 20 45, 33 71 34 75 43 25 
135 e 21 47 33 73 41 91 43 95 
134 11 27 60 54 75 40 39 42 93 
131 8 28 51 33 71 35 78 3 93 
122 1 20 «4 28 62 35 78 43 95 
118 5 18 40 30 68 33 73 42 93 
110 10 20 m 30 67 35 78 40 ag 
104 3 14 ol 32 49 28 63 40 89 
102 6 20 ^4 25 o5 29 55 57 83 
99 3 20 et 23 51 29 64 39 87 
87 9 17 38 18 40 25 55 33 73 
85 7 13 27 17 38 24 53 32 71 


Average: 19 43% 37 60% 32 71% 40 88% 
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Table 13a 


Breakdown: Rater Uses His Own Concept of Standard Performance. 
Number of Raters; 4 


Evaluation for accuracy. 


Corrected Sequence 154 +74 +10% +20% 
Ratiugs Shown 
No. % No. % No. 4 Bo. 4 
153 12 24 44 32 58 35 65 5 Θὲ 
142 4 24 44 25 46 33 61 90 038 
126 11 27 50 36 67 45 83 50 es 
130 6 23 45 35 65 5 80 43 81 
121 1 94 44 36 67 42 80 49 el 
117 5 24 44 37 66 36 70 Si 94 
104 10 ig 22 23 43 30 55 49 91 
97 2 20 37 28 52 37 ο 48 £9 
94 6 17 32 21 39 23 43 43 60 
92 y 19 «0 22 4] 28 53 47 87 
80 9 15 23 16 20 2% 4S ¿8 70 
78 7 15 25 20 37 34 44 28 το 


δ 
E 


Average: 20 37% 38 51% #34 6 47 87 
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Table 13b 





PreakGown:  Rater Uses His Own Concept of Standard Performance. 
Evaluation for consistency. 





ber of Raters: 54 






verzge Senuence 15% +73% 4107 420% 
Ratings Shown 

l πο. % πο. % Eo. 4 πο. 4 
147 12 17 52 ol 57 cg 72 50 Ga 
134 4 24 ¿e 84 62 46 85 se 56 
154 11 29 55 39 72 44 61 50 22 
138 8 ig 30 aT 50 4d 80 48 Gi 
120 1 27 50 32 se ὁ ὦ RO 49 81 
114 5 ac 52 35 65 40 14 51 C4 
108 10 28 33 26 45 $6 67 48 69 
102 2 20 37 ¿0 56 34 65 de te 
162 6 el 53 30 56 30 56 48 Te 
ee $ 16 30 80 56 37 68 4? 87 
es 9 14 23 18 $3 a7 DO &2 78 
es 7 13 24 14 85 19 OS 3D 65 


Average: 20 38% 29 53% 37 68% 47  €e7 
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Table 145 
Breakdown; Rater Uses Some Film or Other Embodiment of 
Standard Performance. 
Number of Raters: ۰ 


Evaluation for accuracy. 


Corrected Sequence +5% 471% 410% 420% 
Ratings Shown 

No. % No. € No. € Ho. $ 
155 12 8 53 14 93 15 100 15 100 
| 143 4 4 oF 8 63 14 93 15 100 
137 u 11 73 αι 73 14 93 15 100 
131 8 9 80 12 80 12 80 15 100 
122 1 8 53 10 67 12 80 15 0 
118 5 5 33 11 73 13 87 15 100 
104 10 6 0 6 @ it m 15 100 
98 à 10 587 11 73 13 87? 15 100 
95 6 8 53 9 60 11 73 15 100 
92 E 5 55 7 47 8 53 14 5 
81 9 8 185 $3 30 4 BY 13 0? 
78 7 4 37 6 40 6 658 14 8 


Average: 7 444 9 61% 1 75% 15 98% 
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Breakdown: 


Number of Raters: 


15 


Table 14b 


Evaluation for consistency. 


Average 
Retings 


150 


Avernpre; 


Sequence 
Shown 


13 
de 


11 


al 


10 


~ Ὁ ο QQ N 


45% 
No. % 
12 80 
12 80 
10 67 
10 67 

8 60 
5 33 
9 60 
? 40 
8 53 
10 87 
4 27 
E 37 
8 56% 


473% 
No. % 
15 100 
15 87 
11 75 
10 67 
ii 7 
10 67 
15 100 
13 87 

g 60 
11 % 

5 33 

7 40 
11 72% 


4107 
No. % 
15 100 
14 93 
14 93 
11 73 
14 23 
12 80 
15 100 
14 Qo 
12 80 
15 87 
9 60 
9 60 
153 84% 


i5 


Rater Uses Some Film or Otner Embodiment of 
Stenderd Performence. 


100 
100 
100 
100 
100 
100 
10C 
100 

67 

93 


98% 
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11 54 27 Si 38 4 
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1 54 25 g4 33 84 
5 19 51 35 78 85 95 
10 6 55 1 55 156 ει δὲ νε 
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6 15 41 16 4 10 δι 33 δν 
3 15 4l 20 54 23 68 0 81 
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Breakdown: 


Kumoer of 


Plant employees number 101-1000. 


raters: 


57. 


Table 16b 


Evaluation ior consistency. 


Average 
Ratings 
144 
134 
133 
138 
119 
117 
109 
100 
101 
96 
85 
82 


Average: 


Sequence 
Shown 


12 
+ 
11 


10 


ο m a ο ὃν 


45% 
No. % 
15 4] 
19 51 
24 65 
11 50 
91 57 
16 46 
14 $8 
16 45 
14 «9 
16 45 

9 34 
16 4c 


16 


17M 

No. ἡ 
20 54 
24 65 
38 76 
19 Dd 
28 76 
95 66 
21 57 
al 57 
19 51 
18 49 
11 50 
17 46 


57% 


+10% 
No. % 
33 78 
¿1 84 
ol 84 
39 78 
Ὁ 1 84 
27 T% 
25 70 
37 73 
33 53 
23 62 
19 Si 
18 49 
26 71% 


+20% 
No. % 
354 98 
35 9o 
33 89 
32 87 
ò 89 
35 95 
33 87 
34 93 
Si 84 
öl 84 
28 76 
26 70 
32 86* 
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Table 170 


Breukdown: Plant employees number greater than 1000. 
Number of raters; 2i 


Evasuation for cousistency. 


Average Sequence 45% 473% 410% 4204 
Ratings Shown 
yo. #8 No, É No, ἡ No. # 

149 12 13 62 14 67 20 ۵ 21 100 
136 4 14 67 17 81 20 86 81 100 
185 11 10 48 13 62 20 96 $i 169 
AGO 8 11 53 15 72 16 76 21 100 
132 i 10 45 13 62 14 67 dl 100 
117 5 9 es 13 57 14 67 20 96 
108 10 10 48 15 783 17 8l LY Gi 
10€ 2 6 38 11 55 14 67 19 91 
104 6 7 38 12 57 13 63 18 86 
101 ὁ 12 ET 16 63 17 61 30 96 
82 9 7 23 11 De 12 57 18 65 
BD 7 6 29 3 4S 11 53 16 16 


Average: 10 46% 
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Table 18a 








Breaxzdown;  9ize of town less than 5000. 
Number of raters; 17 


Pvaluation for accuracy. 


45% 174% +10% +20% 
no. % Xo. % Yo. % No. 4 
14 83 15 88 15 88 17 100 

8 ۷ i 7۲ la ο 17 100 


loc 11 13 71 14 83 16 94 17 1ος 
138 8 a 24 8 47 13 75 16 4 
119 1 13 77 i5 88 15 88 17 10€ 
114 Ὁ 10 c9 13 75 15 %8 16 ۶ 
105 19 3 18 O 29 5 99 16 94 
JE 2 5 47 10 59 io 88 17 100 
9 6 6 35 6 39 6 35 16 94 
90 ὦ 6 35 8 71 13 79 16 24 
79 9 4 24 6 “5 6 ¿5 ag τσ 
77 7 7 41 10 59 11 65 14 ac 


Average: 8 47% 11 62% 12 71% 16 944% 
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Table 18b 





Breskdown: Size of town less than 5000. 
lumber of raters; 17. 
Evaluation for consistency. 

















a. No. % πο. 4 

12 11 65 15 88 

4. 9 53 12 71 

ii 12 71 14 83 

e 4 a4 e 47 

1 13 77 15 BR 

112 5 Y 41 11 65 

LOS 10 7 41 p 65 

98 2 14 65 12 71 

93 6 6 35 6 35 

| 90 $ 6 35 12 71 

82 9 6 25 8 53 

17 7 7 41 10 59 
Avera e: 8 49% il 66% 


+10% 
No. £ 
15 88 
13 77 
15 86 
13 77 
16 δε 
14 83 
14 83 
14 8% 
8 47 
16 Y 
10 59 
1l 65 
14 816 


420% 

$ 
17 100 
17 100 
17 100 
i6 94 
17 100 
16 94 
16 96 
17 100 
18 94 
16 94 
13 m 
14 83 
16 94 
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Table 19a 


7. 


1205 


310% 


473% 
νο. 





es 


86 


57 


43 


e) 


23 


2 


11 


86 


«9 


86 


to 


7 105 


57 


43 


3 


29 


£6 


71 


71 


us 


57 


66 


71 


oT 


10 


86 


57 


45 


86 


71 


29 


86 


45 


[o 


14 


14 


4 


4% 


3 


29 





82 


gat, 


6 


37% 


2 


Av er»£2; 





TT 


299".*52429r 


Ee! 
e 





E 


Pe a ro 

و و و ο‏ | 
gynerquavéeseut‏ 

8 4 3 ۶ 5 8 ۶ 2 35855 

e‏ و ا 
ES25525538‏ * 

IN np. 

1 11 ٩ ۶ 8 2 ٩ 5 ۶ ۶ 5 








i" we $ 


Me 2 Wee 4 e 


Table 19b 
Bize of town 5,000 - 10,000. 


۲ raters: 7. 








for consistency 
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Table 20a 


Size of town 10,000 - 35,000. 
er of raters: 29 
&lusticn for accuracy. 





Secuence 45% +74% 410% +204 
No. % πο. 4 yo. é So. < 
12 8 42 11 58 13 68 19 100 
4 7 37 9 47 12 63 19 100 
156 11 9 47 13 63 18 84 18 160 
150 8 8 43 11 ۵ 58 18 684 19 100 
131 8 42 15 7 18 55 19 100 
117 5 8 48 10 53 14 74 18 100 
104 10 5 26 B 42 12 63 17 50 
97 2 6 82 8 42 9 47 19 100 
94 6 mM 8 42 8 42 16 84 
92 3 1 5 2 11 5 26 16 84 
80 9 3 16 $ 16 6 38 i3» 83 
78 7 1 5 5 26 7 37 15 79 


Average: 6 312 Ə ¿5% 11 58% 17 ۴ 
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Table 20b 





Breakdown: Aize of tem 10,000 = 35,000 
Numoer of raters; 19 


UWvalvation for consistency. 


veraze Sequence 45% 473% +10% 4207 
tines Shown 3 
No. % Ko. % Ho, % No. 
146 12 ı ti we wet 15 
182 4 10 53 17 90 18 95 18 
130 11 ιο $8 ο ο ο ο = 
126 8 6 ο 1 8 13 79 19 
190 1 9 47 1 7 18 55 19 
115 5 8 42 10 583 16 84+ 19 
105 10 7 -" 8 ο 18 © u 
104 2 5 26 10 53 13 69 19 
103 8 8 $2 18 63 14 74 18 
Yg 3 14M 145 it M 
85 3 4 21 4 21 8 42 15 
85 7 7 8F #108 u 58 1 
Average: 7 34% 11 9% 14 74£ 18 
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3 # 5 6 5 4 


۲ ۶ 5 5 6 ۰ 5 ۶ ۸ ۰ + ٩ 
* 58 5 # 5 ۶ ۸ ۶ 8 6 با به‎ 
؟‎ 85 ۶ 3 3 4 2 ۷۰ ۷ ۵ 5 4 
ο ος 
SREP EC eee 
* 5 ٩ ۶ ۶ ۶ ٩ ۶ 8 ۶ 5 5 8 
٩ : ۱ ۰ 5 6 ۷ 8 و‎ 
* 2 5 5 5 8 5 ۲ 5 ۶ > + 
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Bresk dc WE; 


Number of 


Lvaluation tor accuracy. 


Corrected 
Ratings 
153 
141 
135 
130 
121 
117 
104 
97 
94 
93 
80 
76 


Average: 


Table 2la 


Size of town 25,0.0 - 50,000. 


Raters; 10. 


Sequence 45% 
Shown. 
Xo. % 
13 & 40 
4 6 60 
AL 5 50 
8 3 30 
1 4 40 
5 2 90 
10 8 40 
2 4 40 
6 à 30 
ó 6 60 
9 4 40 
7 2 20 
4 39% 
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Table 238 


Bresxdown; Size of town 50,000 - 100,000. 

Number of raters; 7. 

Lvaluation for acuuracy. 

Corrected Sequence 45% 474% 1104, 4206 


Ratings Shown 
Fo. % Yo. % No. € No. € 


159 13 5p Yi Ss m 7? 100 7 100 
147 €. 2 8 o 43 4 sv 7 του 
141 11 ó 43 7 100 7 100 7 100 
136 8 c o7 5 πλ 7 ۶ “ 0 
136€ 1 S 43 4 57 & By €e = 
191 5 4 57 4 57 6 ΒΡ 7 100 
108 10 8 ۵ 3 43 4 57 6 86 
101 2 1 14 3 43 6 89 à 85 
98 6 C ο 4 57 B wn 7 100 
95 3 2 28 o 28 3 43 ? 160 
83 9 0 0 i 14 ó 45 6 88 
8i 7 1 14 1 14 1 14 5 71 


Average: 2 38% 4 50% 5 68% 7 934 
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Table 28b 


Breakdown: Size of town 50,000 - 100,000 
Fúmber of raters: ^". 
Evaluation for 





Sequence مق‎ i 4 | 
e” Sequence ἐδή 472% 410% 420% 





πο. % No. € πο. 4 πο. 4 
154 12 8 ۷ +10 ؟‎ 18 ? 100 
137 4 8 43 5 71 27 100 7 100 
139 11 38 48 6 85 7 100 7 100 
133 8 5 71 6 8 5 85 7 106 
118 1 ra ır ı ۷۹ υπ 
131 E 4 5 4 P^ 41M > 8 
117 10 es ۲ MT F S 
101 2 l 14 3 43 6 85 6 5 
103 6 3 43 4 57 4 57 7 100 
101 2 $ 38 5 38 56 85 7 10 
98 0 8 3 5 71 6 85 6 85 
93 7 u 4 4 57 =? 100 


Average: 3 406 5 6% 6 82% 7 95% 
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Tabie 23a 


Breakdown: Size of town over 100,000. 
Number of raters: 11. 


Evaluation for accuracy. 


Corrected 3ecuence +54 1714 
Ratings Shown 
Fo. % Ho. € 
154 13 a 18 “ 26 
142 4 3 27 3 27 
136 11 a 18 4 36 
131 8 5 46 5 46 
121 1 2 18 > 36 
117 5 2 18 > 36 
104 10 3 37 6 55 
97 2 8 73 8 73 
94 6 5 46 6 55 
92 3 4 56 5 46 
80 9 2 18 2 18 
78 7 a 18 4 36 


Average: 3 30% 5 4 
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Humber of raters: 
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Table 23b 


Evaluation for consistency. 


Average 
Ratings 
149 
138 
131 
128 
120 
107 
109 
103 
100 
101 
87 
83 


Average: 


Secuence 
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Size of town over 100,000. 


173% 


No. 4 


f 


41% 


410% 
No. % 
5 46 
5 46 
6 ob 
6 55 
7 64 
8 73 
5 46 
6 56 
6 55 
6 55 
4 36 
à 18 
6 50% 


420% 
Ko. % 
7 θά 
8 73 
8 73 
7 64 
8 79 
9 82 
8 76 
B 75 
8 75 
7 64 
7 64 
6 55 
6 694 
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Table 24 


63 


Results of Analysis-of-Variance Tests 


Ares 3.21 6.64 
Experience 1.i} 1.67 
Education 6.48 7.11 





Joncept of 
"standard performance" 3.05 8.64 


No. of employees 1.03 3.30 
Size of city 3.03 2.60 


Fos 


2.95 
2.88 


243-=F005 


4.84 
2.44 
3.88 


Significant 


Yes 
ΤΟ 


At 10% 


At 10% 


No 


Barely at 
10% 


Feo and Fog indicate computed F's at the 15$ and 410% 


levels of accuracy. 


Fos is tabulated values of F at the 5% level of 


significance., 
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Fig. 19 
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Fig. 20 
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| end release load. 


b description of the eynthetic task; scribe end of 
dins, using return chute. 
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MATHEMATICAL PROCEDURE 


Mathematical procedures involved the computing of the 
true pace or “corrected rating" for each pace; the use of the 
"analysis—of-variance" technique, and fitting a line to a 
series of points by the method of “least squares". A short 
discussion on these procedures follow. 

1. Computing the true pace or “corrected rating". 

a. Designate "corrected rating" as X,. 

b. Obtain the average frame count per cycle for 
each pace. Designate the frame ccunt as Ry. 

c. To any one of the paces aseign the value 100. 
Let this be pece number 10. Designate this asg X197100. 

d. Since each pace bears a fixed relationship to 
all other paces, the relationship being the ratio of their 
respective frame counts, we have the equation Xf x Np=C, a 
constant. We now find Kf for each pace from this equation 
and X{9=100. 

e. The “corrected rating", X,, bears the following 
relationship, Xp"XXA, where K is a constant. A formula 
for deriving K will be given in a zubsecuent paragraph. 


f. With the value of K determined, compute Xn, 


These values of Xp are in a direct ratio with each 
other according to their respeotive frame count per cycle, 
are related to the raters! average, and represent the near- 


est approach possible to a true rating. 
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Proof that Kz ° This proof was derived by 
X42 
Dr. M. E. Mundel,"'Professor of Industrial Engineering, 


General Engineering Department, Purdue University. 


Y 

Yn y a X 

Y3 

Ya 

Yı 

0 κει KX} KX! KX} X 


Problem: To find the best set of X valued about Y=X. 
Given: Xx >» و وگ‎ Xp» the corrected ratings for 


each pace. 


C 
۱ ۱ ña ' 
X: 3 Xe 9 999 9 9 2 X= x, 


Yi, Ya, leen, t 


n» the average of the raters’ 


estimate for each pace. 

K is a constent to be selected such that Σαξ 
equals a minimum, where d is the variation about the line 
Ys X. 

Proof: ۶ 4 2 ) = και) + (Yo - KX,) ا‎ (YEK). 
ςαξ- ἡ - aKKY, 4 KX + ... + (Yg = KK). 
The value of K which will permit Şa? to be a minimum is 
obtained by setting the partial derivative of 2 with 
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respect to K equal to O and solving for K. 
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Solving for K we have, 
aa وی + ... + ولا + امین‎ 
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2. Analysis-of-variance technique. 
Details of the analysis-of-variance tests are not pre- 
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sented here?? but it can be shown that if we have the variable 


X arranged in the following manner, 





these values of X are random sample 


assune 
Values from a acrmal population with mean m and variation T, 


and if we 





10 Paul G. Hoel, Introduction to — — Statistics, 
& Sons, Inc., Mew York, 1949. 


p. 154-161, John Wiley 
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The numerator, with (b-1) degrees of freedom, measures 
variation between columns. The denominator, with (a-1)(b-1) 
degrees of freedom, measures the "experimental error", that 
is, variation in the fundarental veriaole efter row and column 
effects have been eliminated. 


In this thesis, a 15 the number of paces, b is the number 


of breakdowns, X is the percentage of raters within +5% of the 


corrected reting or any designated level of accuracy. 

Fy Was computed at the +5% and +10% levels of accuracy 
for gach category of breakdown and was comparec with the 
tabuler value of F at the 5% level of significance. 

8. Fitting a curve to a set of points by the method of 
"least squares". 

Details of the method of "least squares" will not be 


presented here but involves the use of the following equations. 


2 ۲ < all + AX. 
SXYs aSx + mB EX. 
a =intercept, m =81lope. 
With the values of a and m determined we substitute them 


in the general equation for a etrsight line, Y=mk + a, and 


| obtain the line best fitting the available points. 





11 Ibid., p. 79. 


91 


11 




















(1-4) (Ine) va - | Ri 





— 


—— ilk 

(£-4)[£-8) dilm ,tojpaimoaed off . afm i00 اد هه‎ 

tect ,“sorre Intasmizsqne® sits aun EL 14 asê teb 

wou vette santa” nz ۳‏ وا 1۵9 کی 
asod pva NUON‏ م1 11۵1 . 


> 
sada «dj vi d ,seogg 1ο τοάπυπ oat al A ۵ até me 
" 





end to Bis nidils Arster Yo epájusoisn si) el X p 
۷۲۵21۲۵۵9 to level 9380۵1۷95 ۷8 0 gata b 

— ی To 9 15 ROLE bns Fer edd js‏ 1۱9۵8 هد 

| edt dity jotagmoo Se" bay arobine rd To — 

‚sonnottingte to [evet AP edt ds T to sudy y 

to hodiwse 5317 τό van to j^^ » of πντοῦ α رم‎ .E 

zi - ."setaups faast* 


od ton ifin *aetewpe Agel" To ۵ eis To eltased 





II 


Agotdgupe gatwoifot ef) to sau edd Soviovit Sul Oma ۱62 که‎ 


- 


¿a 4 "a =15 
| xom + Kp YXS 
l .900۵ ۷ ۶ «FONTS e 
eadt atutiteadue sw fentrtedeb s ba» a to Selev edd ۴ 

bas ıs + Ka=Y „enil $dglov!h κ xot mottanpe ۵ eds al 
631 05 91119 edt grtts(? seed watt ede nisddo 





BIBLIOGRAPHY 















nes, R. M., Motion anc 
ns, Inc., New York, Αι 


rrus, B. S., "The Present State of Time Study", Unpublished 
sters Thesis, Purdue University, 1950, 





judy, Sra ed., John Wiley 4 





e, P. G., * ۰۰. da Statistics, John 


E Sons, “τ ., N = fork, 845. : ا‎ 





ürer, R. N., "Development and Evaluation of a Pace Scale 
Time Study Rating", Unpublished Doctors Thesis, Purdue 
iversity, 1949. 


ergolin, Louis, "A Comparison of The Methods of Presentation 
or Time Study Rating", Unpublished Masters Thesis, Purdue 
nivertity, 1948. 


adel, M. E. زە‎ 
nC., New York, 








SETave, Ralph, LJ y amıcB Oi 
411 Book Co., Inc., "ew York, 








uf 4 us > 


bm Ea — 


do, Pace Tarr Zas THE 














A T åP "D‏ سس 


5257 A lo üóliagisv? fus ὑπ 
4 ¿lod T atoto0l سل ود‎ 


m | | ὦ. W ys 


EE 


iae» j) ΙΙΙ. ΙΠΝ.. -—— Te". 






















¿ABR 
| 
| r- sj Pe HMM 
۹ to Pla YA [Τα 7 
AR INMEMS 14 ۰ 


| UJ ۲ «Y 
۱ ود ون‎ -. 






- 15394 
. - - -' 

۱ ۱ ۱ ~ 4! 

۱ P-1 T - ιά 
— — 
owt Y) 





------ 


ΜΕ 





me 


N 


Ws 


jar 


i^ 


| [|| 
| i i 


| 


| 


| 


| 


| 
| 


| 
| 


| 


| 
| 


| 
Il 


|] 
{| 


| 
| 


| 


|| 
زا 


I 





